Adaptive Multi-layer Contrastive Graph Neural Networks
نویسندگان
چکیده
Inspired by recent success of graph contrastive learning methods, we propose a self-supervised framework for Graph Neural Networks (GNNs) named Adaptive Multi-layer Contrastive (AMC-GNN). Specifically, AMC-GNN generates different views through data augmentation and compares the output embeddings at layers neural network encoders to obtain feature representations downstream tasks. Meanwhile, learns importance weights adaptively attention mechanism, an auxiliary encoder is adopted train better. The accuracy improved maximizing representation’s consistency positive pairs in intermediate final embedding space. Experiments on node classification link prediction demonstrate that outperforms state-of-the-art methods even sometimes supervised methods.
منابع مشابه
Adaptive Graph Convolutional Neural Networks
Graph Convolutional Neural Networks (Graph CNNs) are generalizations of classical CNNs to handle graph data such as molecular data, point could and social networks. Current filters in graph CNNs are built for fixed and shared graph structure. However, for most real data, the graph structures varies in both size and connectivity. The paper proposes a generalized and flexible graph CNN taking dat...
متن کاملGrowing adaptive neural networks with graph grammars
This paper describes how graph grammars may be used to grow neural networks. The grammar facilitates a very compact and declarative description of every aspect of a neural architecture; this is important from a software/neural engineering point of view, since the descriptions are much easier to write and maintain than programs written in a high-level language , such as C++, and do not require p...
متن کاملThe Application of Multi-Layer Artificial Neural Networks in Speckle Reduction (Methodology)
Optical Coherence Tomography (OCT) uses the spatial and temporal coherence properties of optical waves backscattered from a tissue sample to form an image. An inherent characteristic of coherent imaging is the presence of speckle noise. In this study we use a new ensemble framework which is a combination of several Multi-Layer Perceptron (MLP) neural networks to denoise OCT images. The noise is...
متن کاملSEISMIC DESIGN OF DOUBLE LAYER GRIDS BY NEURAL NETWORKS
The main contribution of the present paper is to train efficient neural networks for seismic design of double layer grids subject to multiple-earthquake loading. As the seismic analysis and design of such large scale structures require high computational efforts, employing neural network techniques substantially decreases the computational burden. Square-on-square double layer grids with the va...
متن کاملMulti{Layer Neural Networks with a Local Adaptive Learning Rule for Blind Separation of Source Signals
In this contribution a class of simple local unsupervised learning algorithms is proposed for multi{ layer neural network performing source signal separation from linear mixture of them (the blind separation problem). The main motivation for using a multi{layer network instead of a single layer one for the blind separation problem is to improve the performance and robustness of separation while...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neural Processing Letters
سال: 2022
ISSN: ['1573-773X', '1370-4621']
DOI: https://doi.org/10.1007/s11063-022-11064-5